Asymptotic normality of robust M-estimators with convex penalty

نویسندگان

چکیده

This paper develops asymptotic normality results for individual coordinates of robust M-estimators with convex penalty in high-dimensions, where the dimension p is at most same order as sample size n, i.e, p∕n≤γ some fixed constant γ>0. The requires a bias correction and holds M-estimator large class loss functions including Huber its smoothed versions regularized strongly penalty. variance that characterizes width resulting confidence intervals estimated data-driven quantities. estimate adapts automatically to low (p∕n→0) or high (p∕n≤γ) dimensions does not involve proximal operators seen previous works on M-estimators. For loss, has simple expression involving an effective degrees-of-freedom well size. case Elastic-Net studied details simulation study confirms theoretical findings. follow from Stein formulae high-dimensional random vectors sphere developed which are independent interest.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Statistical consistency and asymptotic normality for high-dimensional robust M-estimators

We study theoretical properties of regularized robust M -estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavytailed distributions and/or outliers in the additive errors and covariates. We first establish a form of local statistical consistency for the penalized regression estimators under fairly mild conditions on the error distributio...

متن کامل

Asymptotic Normality for Deconvolving Kernel Density Estimators

Suppose that we have 11 observations from the convolution model Y = X + £, where X and £ are the independent unobservable random variables, and £ is measurement error with a known distribution. We will discuss the asymptotic normality for deconvolving kernel density estimators of the unknown density f x 0 of X by assuming either the tail of the characteristic function of £ behaves as II I~Oexp(...

متن کامل

Towards the study of least squares estimators with convex penalty

Penalized least squares estimation is a popular technique in high-dimensional statistics. It includes such methods as the LASSO, the group LASSO, and the nuclear norm penalized least squares. The existing theory of these methods is not fully satisfying since it allows one to prove oracle inequalities with fixed high probability only for the estimators depending on this probability. Furthermore,...

متن کامل

Asymptotic Normality of Kernel Type Density Estimators for Random Fields

Kernel type density estimators are studied for random fields. It is proved that the estimators are asymptotically normal if the set of locations of observations become more and more dense in an increasing sequence of domains. It turns out that in our setting the covariance structure of the limiting normal distribution can be a combination of those of the continuous parameter and the discrete pa...

متن کامل

Asymptotic Normality and Efficiency of Two Sobol Index Estimators

Introduction 1 1. Definition and estimation of Sobol indices 2 1.1. Exact model 2 1.2. Estimation of S 3 2. Asymptotic properties: exact model 4 2.1. Consistency and asymptotic normality 4 2.2. Asymptotic efficiency 6 3. Asymptotic properties: metamodel 8 3.1. Metamodel-based estimation 8 3.2. Consistency and asymptotic normality 8 3.3. Asymptotic efficiency 11 4. Numerical illustrations 12 4.1...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronic Journal of Statistics

سال: 2022

ISSN: ['1935-7524']

DOI: https://doi.org/10.1214/22-ejs2065